Recursive ICA
نویسندگان
چکیده
Independent Component Analysis (ICA) is a popular method for extracting independent features from visual data. However, as a fundamentally linear technique, there is always nonlinear residual redundancy that is not captured by ICA. Hence there have been many attempts to try to create a hierarchical version of ICA, but so far none of the approaches have a natural way to apply them more than once. Here we show that there is a relatively simple technique that transforms the absolute values of the outputs of a previous application of ICA into a normal distribution, to which ICA maybe applied again. This results in a recursive ICA algorithm that may be applied any number of times in order to extract higher order structure from previous layers.
منابع مشابه
Recursive Generalized Eigendecomposition for Independent Component Analysis
Independent component analysis is an important statistical tool in machine learning, pattern recognition, and signal processing. Most of these applications require on-line learning algorithms. Current on-line ICA algorithms use the stochastic gradient concept, drawbacks of which include difficulties in selecting the step size and generating suboptimal estimates. In this paper a recursive genera...
متن کاملA New Hybrid Evolutionary Algorithm Based on ICA and GA: Recursive-ICA-GA
In this paper a new method is proposed based on the combination of ICA (Imperial Competitive Algorithm) and GA (Genetic Algorithm) which improves the convergence speed and accuracy of the optimization results. The new algorithm, which is named R-ICA-GA (RecursiveICA-GA), runs ICA and GA consecutively. It is shown that a fast decrease occurs while the proposed algorithm switches from ICA to GA. ...
متن کاملReal-Time Implementation of a Combined PCA-ICA Algorithm for Blind Source Separation
In this thesis we introduce and investigate a method combining Principle Component Analysis (PCA) and Independent Component Analysis (ICA) for Blind Source Separation (BSS). A recursive method for the PCA is applied to meet the demands of a real-time application, and for the ICA algorithm, the Information maximization principle is used. In an effort to address convolutive BSS, the separation is...
متن کاملA process monitoring method based on noisy independent component analysis
Independent component analysis (ICA) is an effective feature extraction tool for process monitoring. However, the conventional ICA-based process monitoring methods usually adopt noise-free ICA models and thus may perform unsatisfactorily under the adverse effects of the measurement noise. In this paper, a process monitoring method using a new noisy independent component analysis, referred to as...
متن کاملBlind Deconvolution of SISO Systems with Binary Source Based on Recursive Channel Shortening
We treat the problem of Blind Deconvolution of Single Input Single Output SISO systems with real or complex binary sources We explicate the basic mathematical idea by focusing on the noiseless case Our approach leads to a recursive channel shortening algorithm based on simple data gouping The channel shortening process eventually results in an instantaneous binary system with trivial solution T...
متن کامل